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IMAGE-ENABLED ITEM PROCESSING FOR POINT OF PRESENTMENT 

APPLICATION 

FIELD OF THE INVENTION 
[0001] The present invention generally relates to financial transaction 
systems, methods, and devices, and particularly relates to systems and methods 
of transaction automation at a point of presentment utilizing image recognition. 

BACKGROUND OF THE INVENTION 

[0002] Financial institutions typically interact with parties to 
transactions, such as individuals, partnerships, companies, and corporations, by 
providing points of presentment at locations that are convenient to the parties to 
the transactions. Points of presentment include, for example, front counters of 
bank branches, cash vaults, merchant back offices, and automatic teller 
machines (ATMs) providing deposit automation. Parties to transactions typically 
present physical items embodying a transaction at these points of presentment, 
and these items typically include checks, cash, withdrawal slips, deposit slips, 
loan payment slips, and/or remittance slips. 

[0003] While tellers often assist parties to transactions at some points 
of presentment, these tellers are typically required to spend excessive amounts 
of time and attention merely ensuring that a transaction is in balance. 
Furthermore, the tellers typically have no way of ensuring that all items of a 
transaction are valid. In addition, points of presentment affording no teller 
assistance rely entirely on the party to the transaction to ensure that the 
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transaction is balanced. l\1oreover, financial institution branches typically 
assenfible and process items long after the party to the transaction has departed 
the point of presentment. As a result, unbalanced and/or invalid transactions are 
discovered late, without affording the party to the transaction or teller at the point 
of presentment an opportunity to correct or othenvise balance the transaction. 

[0004] The need remains, therefore, for a system and method of 
processing a transaction at a point of presentment that improves quality control 
of transactions while reducing time and labor requirements at a point of 
presentment. The present invention fulfills this need. 

SUMMARY OF THE INVENTION 
[0005] In accordance with the present invention, an image-enabled, 
financial transaction processing system for use at a point of presentment 
includes an input receptive of an image of a physical item at least partially 
embodying a financial transaction, wherein the image contains a visual record of 
an amount of monetary value. An image recognition module is adapted to 
extract the amount of monetary value recorded in the image and recognize the 
amount using character recognition. A validation module is adapted to determine 
whether the transaction is valid based on a validation characteristic of an item. A 
balancing module is adapted to determine whether the transaction is balanced 
based on the amount of monetary value. An output is adapted to transmit 
information indicating whether the transaction is at least one of balanced and 
valid. 



2 



Attorney Docket No. 5983-000008 

[0006] Further areas of applicability of the present invention will 
become apparent from the detailed description provided hereinafter. It should be 
understood that the detailed description and specific examples, while indicating 
the preferred embodiment of the invention, are intended for purposes of 
illustration only and are not intended to limit the scope of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0007] The present invention will become more fully understood from 

the detailed description and the accompanying drawings, wherein: 

[0008] Figure 1 is an entity relationship diagram illustrating a financial 

transaction system implemented at a point of presentment according to the 

present invention; 

[0009] Figure 2 is a functional block diagram illustrating an image- 
enabled, financial transaction processing system for use at a point of 
presentment according to the present invention; 

[0010] Figures 3 and 4 are flow diagrams illustrating an image-enabled 
item processing method for use in performing a financial transaction at a point of 
presentment in accordance with the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0011] The following description of the preferred embodiment(s) is 

merely exemplary in nature and is in no way intended to limit the invention, its 

application, or uses. 
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[0012] Figure 1 illustrates a point of presentment 10 implementing the 
image-enabled, financial transaction processing system in accordance with the 
present invention. It is envisioned that a financial institution according to the 
present invention has a central location 1 2 with a relational transaction datastore 
14 and centralized business rules 16. The central location 12 promulgates 
business rules 16 by daily transmitting business rules data 16A over a 
communications network 18, such as the Internet, to plural points of presentment 
10. In turn, point of presentment 10 daily receives rules data 16B and stores it in 
rules datastore 20. Rules datastore 20 may include validation characteristics 
datastore 22, which stores validation characteristics for authenticating identity of 
parties and/or items. Validation characteristics may include routing numbers for 
financial institutions, account numbers for parties to transactions, one or more 
signatures or other biometric characteristics of individuals, and/or encryption 
keys, hash functions, and similar code features relating to digital watermarks, 
holograms, and other item features. As further explained below, business rules 
1 6 of datastore 20 also define how to identify a type of document item based on 
image features and/or codeline data, how to extract, recognize, and utilize 
features from different types of documents, and how to validate and balance 
different types of transactions. 

[0013] In a preferred embodiment, business rules 16 of datastore 22 
include one or more electronic forms relating to different types of transactions, 
with methods for correlating item type locations with form fields and data type, 
and with a balancing function relating fields of the form. In operation, an operator 
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at the point of presentment, such as a party to the transaction or teller assisting 
the party to the transaction, initiates a transaction by selecting an electronic form 
designated for performing the transaction. For example, if a teller selects to 
perform a deposit, then the teller takes the items 24, including a completed 
deposit slip, checks, and cash, from the party to the transaction at the point of 
presentment, and scans each of the checks and the deposit slip using imaging 
and scanning mechanism 26. If is envisioned that scanning mechanisms that 
read magnetic ink, image items, and sort items may be employed to validate 
and/or count a non-cash portion of the transaction. It is further envisioned that 
bill and/or coin acceptors, such as those employed with vending machines, may 
be employed with the present invention to validate and/or count a cash portion of 
the transaction. Such interface mechanisms may prove especially useful in 
implementations not affording teller assistance, such as with ATM deposit 
automation. It is yet further envisioned that a physical deposit slip may not be 
required in some embodiments of the present invention, and that an electronic 
form distributed to a user on a touch screen accepting a user signature, 
thumbprint, or other biometric, may serve as a substitute deposit slip. 

[0014] Item images 28 are collected and stored together with 
recognized magnetic ink data, and each image is assigned a unique document 
identification number (DIN). Transaction processor 30 preferably identifies a type 
of item for each image based on magnetic ink codeline data associated with the 
image and in accordance with business rules 16 of datastore 20. It is envisioned 
that transaction processor 30 may also recognize types of items using image 
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feature analysis. A poor image resulting, for example, from a folded corner 
results in display of the image on active display 32 of output 34 with a request 
that the Image be rescanned. It is envisioned that other image quality control 
measures may also be employed. Transaction processor 30 performs feature 
extraction for item images 28 of sufficient quality and uses intelligent character 
recognition 32 to recognize the feature content for certain types of features. The 
recognized feature content, such as an amount of monetary value, is optionally 
combined with other feature content and inserted into a related field of electronic 
form 38. The field is related to the recognized feature content because it is 
associated with the particular extraction and recognition function employed to 
obtain the content from the item image. A balancing function of the form 38 
compares a total of certain of the form fields to an extracted total to determined if 
they match. The filled form 38 is displayed on active display 32 with a message 
indicating whether the transaction is balanced. 

[0015] Transaction processor 30 also employs validation module 40 to 
validate each item 24. For example, magnetic ink codeline data extracted from 
an item corresponding to a check may be used to compare a routing number of 
the codeline data to routing numbers of financial institutions stored in datastore 
22. An account number from a check, deposit slip, or withdrawal slip can 
similarly be compared to an account number of a party to the transaction that is 
stored in datastore 22. Also, image features, such as signatures, icons, digital 
watermarks, and Identifying text may be extracted, optionally recognized, and 
compared to similar types of data stored in datastore 22. For example, a 
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signature can be aligned with a signature in memory to obtain a similarity metric 
useful for authenticating identity of a party to the transaction. If an item cannot 
be validated, a message indicating invalidity of the item is communicated to 
active display 32, and the item image and any recognized data are automatically 
removed from the transaction. This removal may throw the transaction out of 
balance. Therefore, the items can be returned to the party to the transaction at 
the point of presentment for correction immediately. 

[0016] The teller may count the cash portion of the transaction and 
enter the cash portion Into the electronic fomn via input 42. A substitute cash 
ticket image is created based on the cash amount, and the substitute cash ticket 
is added to images 28 of the transaction. The teller may also enter corrections 
44 to replace field contents or add contents to empty fields in the case of failed 
recognition attempts. It is envisioned that the party to the transaction may enter 
these corrections in embodiments where teller assistance is not available. Once 
a validated transaction is in balance, the operator has the option of posting the 
transaction by communicating the transaction 46A and 46B to transaction 
datastore 14 of central location 12 via communications network 18. Accordingly, 
the item images 28 may be marked as truncated and communicated over 
network 18. It is also envisioned that filled form 38 may be bundled with one or 
more of the item images 22 in transaction 46A and 46B. As a result, the 
transaction can be reliably validated, balanced, and posted in a short amount of 
time in presence of the party to the transaction at the point of presentment. 
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Meanwhile, the physical Items 24 can be assembled and physically transported 
in turn, if necessary when truncation is not enabled. 

[0017] Figure 2 illustrates function of transaction processor 30 in more 
detail. Data input 26A is receptive of electronic item images and magnetic ink 
codeline data 28A and 28B, which are stored in datastore 48. Recognition 
module 50 performs feature analysis, extracts image details 52, and recognizes 
image content for form fields 54 according to business rules of datastore 20. 
Validation module 40 compares codeline data and/or extracted details to 
validation characteristics of datastore 22 according to business rules of datastore 
20. It is envisioned that extracted details may further be recognized as form 
fields 54, and codeline contents may be compared to corresponding recognized 
form fields as part of the validation process. Recognized form fields 54 and a 
validity decision 56 for each item are communicated to balancing module 58, 
which communicates form filling results 60, a balance decision 62, and/or one or 
more validity decisions 56 to an operator via output 34. It is envisioned that the 
identity of the operator may vary according to the accommodations afforded by 
the point of presentment. However, communication is maintained with the party 
to the transaction at the point of presentment of the items throughout the 
correction and balancing process, whether directly or through a teller assisting 
the party to the transaction. 

[0018] Posting module 64 evaluates each image of datastore 48, and 
determines whether an image is flawed. If so, a rescan request in the form of the 
flawed image 66 is communicated to the operator via output 34. In turn, the 
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operator may input more item images 28A and/or magnetic codeline data 28B in 
response to a rescan request, to replace an item witli a new and/or altered item, 
and/or to add items. Input 42 Is receptive of operator input specifying additions 
and or corrections 44, cash ticket information 68, and/or a post transaction 
command 70. It is envisioned that cash ticket information may alternatively be 
tallied and provided by a system having a bill acceptor and/or coin acceptor. It is 
further envisioned that balancing module 58 may be responsive to other 
commands from an operator, including a command to delete an item, to add an 
Item, and/or to replace an item. Also, balancing module 58 is adapted to create 
substitute cash ticket 72 based on information 68, and to communicate It to 
posting module 72 upon receipt of command 70. In response, posting module 64 
assembles item images together with substitute cash tickets of the transaction, 
marks truncated images as truncated using metadata, and transmits the resulting 
transaction 74 via data output 76. Communication of the substitute cash ticket is 
only one way to trigger posting of the transaction according to the present 
Invention. It Is envisioned that an option to enter a post transaction command 
may be withheld from the operator until the transaction is in balance. It is further 
envisioned that transaction 74 may further include electronic form filling results 
60. 

[0019] The preferred embodiment of the system of the present 
invention having now been described in detail, attention Is now directed to the 
method according the present Invention illustrated in Figures 3 and 4. Figure 3 
illustrates a first portion of an image-enabled item processing method for use In 
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performing a financial transaction at a point of presentment in accordance witli 
the present invention. Accordingly, at step 80, communication is established with 
a party to the transaction presenting physical items embodying the transaction at 
the point of presentment. The operator scans the items, preferably with an 
imaging mechanism having an ability to read magnetic ink. The result is 
simultaneous reading of item images and magnetic codeline data into computer 
memory at steps 82 and 84. The reading of codeline data is accomplished via 
magnetic ink character recognition at step 82. Each item image is assigned a 
unique document identification number (DIN) at step 82, and codeline data from 
step 84 is preferably stored together with the image. 

[0020] At step 86, a document type is identified for each image based 
on recognized contents of the codeline from step 84, and recognition of 
document type may alternatively or additionally be based on image feature 
analysis results from step 88. Identification of a document such as a deposit slip, 
withdrawal slip, mortgage payment slip, or remittance slip may be employed to 
identify the type of transaction, or to notify an operator that a selected type of 
transaction may be incorrect. A record of the document type is preferably stored 
in memory with the image, and the DIN may be based in part on the document 
type. 

[0021] At step 88, image details are extracted from each image based 
on document type and based on business rules specifying locations of details in 
the corresponding type of image. Details are recognized as appropriate to a type 
of the detail using intelligent character recognition at step 90. Image analysis 
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techniques may facilitate these processes by identifying image details as nodes 
related to one another based on document location. Accordingly, a node may 
have a size and shape according to the results of document segmentation. 
Pattern recognition can further identify nodes as containing different types of 
content, such as graph versus text and letters versus numbers. Recognition 
attempts may substitute or confirm pattern recognition. Codeline contents and/or 
party identity may be matched to contents of one or more nodes to assist in 
identifying node type for each node in a process of elimination. Business rules 
may specify which types of image details should be recognized and how image 
detail contents should be utilized. Monetary amounts, party identities, financial 
institution identities, account numbers, routing numbers, addresses, and 
signatures can therefore be reliably extracted from checks, deposit slips, 
withdrawal slips, mortgage payment slips, and remittance slips and utilized as 
detailed below. 

[0022] Extracted and recognized image details are utilized in various 
ways. For example, items may be validated based on codeline data, extracted 
details, and/or recognized detail contents by comparing these predefined 
validation characteristics to a plurality of validation characteristics stored in 
memory. Thus routing numbers may be matched to financial institutions, account 
numbers, extracted and recognized names and addresses, and signatures may 
be matched to parties to transactions. Also, security icons, such as holograms, 
and digital watermarks may be validated according to their predefined validation 
requirements. It is envisioned that input from holographic laser scanning devices 
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and magnetic strip readers may additionally or alternatively be employed as part 
of the validation process. It is also envisioned that an operator, such as a teller, 
may be prompted to visually inspect scan with a special device a particular item 
having special validity characteristics, such as a hologram or a background that 
is designed to be difficult to scan or copy. 

[0023] Extracted details, recognized detail contents, and/or codeline 
data may be compared to one another as part of the validation process. For 
example, an account number of codeline data may be compared to an extracted 
and recognized account number of the codeline data, and the party identity 
associated in computer memory with the account number may be compared to 
an extracted and recognized party identity. Also, an endorsement signature 
imaged on a revere side of the item can be matched by a similarity alignment to a 
signature or signature model stored in memory for the party identity. Further, a 
monetary amount extracted and recognized from one field of a check may be 
compared to a monetary amount extracted from another field of the check. As a 
result, the validation process ensures that items of the transaction are complete, 
correct, and authentic. 

[0024] During the initial scanning process, image quality is maintained 
by image analysis techniques that identify a poorly scanned image as at 94. For 
example, a folded corner may be detected, resulting in communication of a 
rescan request to the operator at step 96. The previously scanned image is thus 
discarded and replaced with the new image of sufficient quality. This folded 
corner may be detected by an overall contrast of the image and/or by failure of 
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an attempt to read the magnetic codeline. A failure of an attempt to read the 
codeline data can also detect improper insertion of the item, such as upside 
down or backwards insertion. Failure to identify a document type may also result 
in a rescan request at step 96. As a result, quality images are obtained and 
stored in association with reliably extracted image details and/or recognized 
detail content, with a document map and/or other metadata identifying document, 
detail, and/or content type in an appropriate business context. Advantageously, 
this useful data is obtained in a short period of time with relatively little effort on 
the part of an operator. 

[0025] Recognized detail contents are utilized to fill fields of an 
electronic form for the type of transaction at step 98 as detailed above. This 
process is defined by business rules specifying correspondence between form 
fields and recognized contents and/or codeline data. Turning to Figure 4, the 
filled form is displayed to the operator at step 100, and any missing fields as at 
102 are highlighted on the active display at step 104. Also, if a balancing 
function of the form cannot match extracted totals to arithmetic combinations of 
related form fields, or if the transaction is invalid as at 106, then an appropriate 
invalidity and/or out of balance message is displayed to the operator at step 108. 
For example, a check total, a cash total, a cash back total, and an overall total 
extracted and recognized from a deposit slip may be appropriately matched 
against one another, against amounts extracted and recognized from checks, 
and against specific enumerations of check amounts extracted and recognized 
from the deposit slip. An operator has the option to supply supplemental input 
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with a keyboard, mouse, touchscreen, microphone with speech recognition 
capability, and/or other input mechanism as at 1 10, to remove an item as at 1 12, 
or to add an item as at 1 14. Receipt of supplemental input at 1 10 may result in 
filling in of missing fields and/or correction of misrecognized fields at step 111. 
Removal of an item may result in removal of the item image and related 
recognition results at step 116 and return to step 98 (Fig. 3). An invalid 
transaction can be made valid by removal and/or replacement of the invalid 
items. It is envisioned that an image of an invalid item may be retained for 
inspection by authorities or other personnel. Replacement of an item may be 
accomplished by recursive removal of the item at 116 (FIG. 4), and subsequent 
addition of an item at 1 14, which returns processing to steps 82 (FIG. 3) and 84. 

[0026] If the transaction is valid and balanced as at 118 (FIG. 4), then 
the operator has the option to post the transaction, thus confirming the form 
fields. Form fields thus confirmed may include extracted and recognized cash 
amounts and/or cash amounts entered by hand or supplied by a bill and/or coin 
acceptor. As a result, the operator provides any needed cash ticket data, so that 
a substitute cash ticket image may be created and added to the transaction. 
Thus, the transaction images and related data may be transmitted at step 120, 
and truncated images may be marked as such with metadata. The option to 
truncate an image may be specified and enforced by business rules, and sorting, 
collecting, and processing of the physical items may be automated accordingly. 
However, if the transaction is invalid or out of balance, then the operator must 
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select one of the aforementioned options otfier than posting the transaction or 
else must terminate the transaction as at 122. 

[0027] The description of the invention is merely exemplary in nature 
and, thus, variations that do not depart from the gist of the invention are intended 
to be within the scope of the invention. For example, a corporate center or other 
point of presentment may have the ability to scan images, but the scanned 
images may be communicated to a remote center that performs one or more of 
the processes of the present invention and communicates results back to the 
point of presentment. Thus, validation may take place remotely in one case to 
ensure security of validation characteristics. This functionality prevents 
distribution of a financial institutions account numbers, code keys, and other 
sensitive data to a corporate client. Remote recognition and correction 
procedures may be similarly supported. 

[0028] Also, it is envisioned that an ATM according to the present 
invention may have a bill acceptor and allow a party to validate a deposit by 
inserting an ATM card and entering a PIN number. Then the user may deposit 
cash to a specified account associated with the ATM card by inserting cash via 
the bill acceptor. The amount of funds to be deposited are then communicated to 
the party by an active display of the ATM, and the party has an opportunity to 
immediately post or terminate the deposit. In the case of a termination, the 
accepted cash is returned to the user. 

[0029] It is further envisioned that an ATM machine may have check 
scanning, imaging, and sorting capability, and will allow the party to insert 
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endorsed checks of a deposit. An electronic form substituting for a deposit slip 
may be displayed to the user, and the party may select cash back and 
electronically sign the form via touch screen capability. Signature recognition 
may be used on the endorsements of the checks and/or touchscreen captured 
signature to authenticate identities of parties to transactions. Also, facial 
recognition, thumbprint recognition, retina scans, and other uses of biometrics 
may further be implemented to authenticate the party identity. Further, checks 
may be validated as detailed above. These checks may be marked paid and 
collected by the ATM. Such variations are not to be regarded as a departure 
from the spirit and scope of the invention. 
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